Structuring the Web to Cope with Dynamic Changes

The web structure yields significant insights into web algorithms for searching, structuring, discovering, mining, and revealing web information. We formalize our view of the web structure in terms of the integer linear programming that converts the web directed graph to the optimal hierarchical structure. The model represents a high level structure regardless of various measures such as the cosine similarity and tf-idf measure of the vector space model as well as the PageRank of Google. Another advantage for our approach is that the corresponding sensitivity analysis yields an allowable range for the optimal structure so that the model can be estimated even though dynamic changes take place in the web pages, links, and structures.